EULERIAN QUASISYMMETRIC FUNCTIONS 
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Abstract. We introduce a family of quasisymmetrie funetions 
called Eulerian quasisymmetrie funetions^ which specialize to enu- 
merators for the joint distribution of the permutation statistics, 
major index and excedance number on permutations of fixed cycle 
type. This family is analogous to a family of quasisymmetrie func- 
tions that Gessel and Reutenauer used to study the joint distribu- 
tion of major index and descent number on permutations of fixed 
cycle type. Our central result is a formula for the generating func- 
tion for the Eulerian quasisymmetrie functions, which specializes 
to a new and surprising g-analog of a classical formula of Euler for 
the exponential generating function of the Eulerian polynomials. 
This (/-analog computes the joint distribution of excedance number 
and major index, the only of the four important Euler-Mahonian 
distributions that had not yet been computed. Our study of the 
Eulerian quasisymmetrie functions also yields results that include 
the descent statistic and refine results of Gessel and Reutenauer. 
We also obtain g-analogs, ((7,p)-analogs and quasisymmetrie func- 
tion analogs of classical results on the symmetry and unimodality of 
the Eulerian polynomials. Our Eulerian quasisymmetrie functions 
refine symmetric functions that have occurred in various represen- 
tation theoretic and enumerative contexts including MacMahon's 
study of multiset derangements, work of Procesi and Stanley on 
toric varieties of Coxeter complexes, Stanley's work on chromatic 
symmetric functions, and the work of the authors on the homology 
of a certain poset introduced by Bjorner and Welker. 
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1. Introduction 

Through our study [51] of the homology of a certain partially ordered 
set introduced by Bjorner and Welker, we have discovered a remarkable 
g-analog of a classical formula for the Eulerian polynomials. The Euler- 
ian polynomials can be interpreted combinatorially as enumerators of 
permutations by the permutation statistic, excedance number. Our q- 
analog is a formula for the joint distribution of the excedance statistic 
and the major index, the only of the four important Euler-Mahonian 
distributions yet to be addressed in the literature. Although poset 
topology led us to conjecture our formula, it is the theory of symmetric 
functions and quasisymmetric functions that provides the proof of our 
original formula, as well as of more refined versions involving additional 
permutation statistics. In the research announcement |50] these results 
and sketches of their proofs were presented. Here we provide the details 
and additional results. 

The modern study of permutation statistics began with the work 
of Major Percy McMahon [311 Vol. I, pp. 135, 186; Vol. II, p. viii], 
[30] • It involves the enumeration of permutations according to natu- 
ral statistics. A permutation statistic is simply a function from the 
union of all the symmetric groups 6„ to the set of nonnegative inte- 
gers. MacMahon studied four fundamental permutation statistics, the 
inversion index (inv), the major index (maj), the descent number (des), 
and the excedance number (exc), which are defined in Section [2l 
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MacMahon observed in [39l Vol. I, p. 186] the now well known result 
that the statistics des and exc are equidistributed, that is, 

for every positive integer n. The coefficients of the polynomials 
were studied by Euler, and are called Eulerian numbers. The polyno- 
mials are known as Eulerian polynomials. (Note that it is common in 
the literature to define the Eulerian polynomials to be tAn{t).) Any 
permutation statistic that is equidistributed with des and exc is called 
an Eulerian statistic. Eulerian numbers and polynomials have been 
extensively studied (see for example [21] and [38]). Euler proved (see 
[5Sl p. 39]) the generating function formula 

1 + 

(1,1) i + 53a.W;^ = ^^. 

re>l 

For a positive integer n, the polynomials [n]q and [n]^! are defined as 

:= 1 + g + . . . + 

and 

n 

Also set [0]g := and [0]^! := 1. MacMahon proved in jlQ] the ffist 
equality in the equation 

after the second equality had been obtained in |18] by Rodrigues. A 
permutation statistic that is equidistributed with maj and inv is called 
a Mahonian statistic. 

Much effort has been put into the examination of joint distributions 
of pairs of permutation statistics, one Eulerian and one Mahonian (for 
a sample see, [3ElM[I3E0lE5l|26l|28lE9l[30lEIl[32lll3lll^ 
l55l [56| [66]). One beautiful result on such joint distributions is found 
in the paper [SH] of Stanley. For permutation statistics fi, . . . , f^ and a 
positive integer ri, define the polynomial 

o-ee„ 

Also, set 

4'-'f^(ti,...,t,) := 1. 
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Stanley showed that if we define 



Exp,(.) :=E^^'^^^mT 

n>0 ^^^'i- 



then we have the g-analogue 

E4inv,dos/ ^ ^ 

„>o " M.! Exp,(.(t-l))-t 

of ([n]). 

Although there has been much work on the joint distributions of (maj, des), 
(inv, exc) and (inv, des) there were to our knowledge no results about 
y^maj.excj^g,^ t) in the existing literature prior to [50], where our work was 
first announced. Our main result on these polynomials is as follows. 
Set 

expg(2) := ^ 

Theorem 1.1. We have 

sr-^ ■ (1 - to) exp„(2;) 

(1.2) 5^Ar'-^(g,t)- ^ ^ 



n>0 L J'^ 



n>0 



\n\\ exp Jztq) -tqexp Jz) 



It is well-known that expg(2;) is a specialization (essentially the stable 
principal specialization) of the symmetric function 

H{z) = H{^,z) :=^/^„(x)^^ 

n>0 

where hn is the complete homogeneous symmetric function of degree n 
(details are given in Section [2]). Hence the right hand side of (II. 2p is a 
specialization of the symmetric function 

{l-tq)H{z) 
H{ztq) -tqH{z)' 

We introduce a family of quasisymmetric functions Qnj,k{'^), called 
Eulerian quasisjnumetric functions, whose generating function 



n,j,k>0 



specializes to 



maj((T)-exc((T)^exc(cr)^fix(o-) 

n>0 o-ee„ ^ ^'^ 
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where fix(cr) is the number of fixed points of a. The Qn,j,k are defined as 
sums of fundamental quasisymmetric functions that we associate (in a 
nonstandard way) with permutations a G 6„, satisfying exc((j) = j and 
fix((T) = k. (These Eulerian quasisymmetric functions should not be 
confused with the quasisymmetric functions associated with Eulerian 
posets discussed in [ll[T9].) Our central result is the following theorem. 

Theorem 1.2. We have 

{1.6) 2^ Qn,,kWtT z - 

n,j,k>0 ^ ^ ^ ^ 



[lA) 



H(rz) 



The proof of Theorem 11.21 appears in Section [31 It depends on com- 
binatorial bijections and involves nontrivial extension of techniques in- 
troduced by Gessel and Reutenauer in [31], Desarmenien and Wachs 
in [15] and Stembridge in [61]. Gessel and Reutenauer construct a bi- 
jection from multisets of primitive circular words of fixed content to 
permutations in order to enumerate permutations with a given descent 
set and cycle type. This bijection, which is related to Stanley's theory 
of P-partitions [S3], has also proved useful in papers of Desarmenien 
and Wachs [HI [15], Diaconis, McGrath and Pitman [16], Hanlon [33] . 
and Wachs [65]. Reiner [16] introduced a type B analog. Here we 
introduce a bicolored version of the Gessel-Reutenauer bijection. 

By specializing Theorem 11.21 we get the following strengthening of 
Theorem II. 1[ 

Corollary 1.3. We have 

^ ' 4^ " ' 'W exp^iztq)-tqexp^{zy 

By setting t = 1 in f 1 1.51) one obtains a formula of Gessel and 
Reutenauer ^T\. By setting r = 0, we obtain a new g-analog of a 
formula of Brenti [TJ Proposition 5] for the exc-enumerator of derange- 
ments. Using Corollary ll.3[ we exhibit in Section [H explicit formulae, 
both recursive and closed, for /imaj,exc,fix_ 

We will show that a different specialization (essentially the nonsta- 
ble principal specialization) of Theorem 11.21 readily yields a further 
extension of Theorem 11.11 that Foata and Han obtained after seeing a 
preprint containing our work 
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Corollary 1.4 (Foata and Han [21]). We have 

^maj,dcs,cxc,fix^^ ^ ^ ^-j ^" _ — q)m{ztq] q)m. 

4^ " ' ' ' (P;^)n+i ((2;;g)m-tg(2tg;g)™)(2r;g)^+i^ 

'1 z/n = 

(l-a)(l-ag)...(l-ag"-i) ifn>l. 

It is well-known that the Eulerian polynomials are symmetric and 
unimodal. In Section E] we use Theorem II. 2l to obtain g-analogs of these 
results for 74™'^-''^™(g, q~^t), and (g,p)-analogs for the derangement enu- 
merator ^maj,des,exc,fix^g,^ q~H, 0). Symmetric function analogs of these 
results for the Eulerian quasisymmetric functions Qn,j,k sue also ob- 
tained. 

Essential to our proof of Theorem II. 21 is a refinement of Qn,j,k which 
is quite interesting in its own right. Given a partition A of n, we define 
the cycle type Eulerian quasisymmetric function Qxj to be the sum 
of the fundamental quasisymmetric functions associated with permu- 
tations that have cycle type A and j excedances. In Section we prove 
that Qx,j is, in fact, a symmetric function. We also obtain another 
symmetry result, specifically: Qxj = Q\^n-k-j for all A h n, where k is 
the number of parts of A equal to 1 and j = 0, . . . ,n — k. By special- 
izing this result we conclude that the cycle type Eulerian polynomials 
A^f'^''''^''^{q,p,q-H) := gmaj(a)-exc(<x)pdcs{a)^oxc(a)^ ^^isrs a raugcs 

over all permutations that have cycle type A and j excedances, is a 
symmetric polynomial in t. We conjecturqj that these polynomials are 
unimodal as well. It follows from Theorem 11.21 that the Eulerian qua- 
sisymmetric functions Qn,j,k are h-positive. We show that this does not 
hold for the more refined cycle type Eulerian quasisymmetric functions 
Qxj, but conjecture that these are Schur positive. We also conjec- 
ture a symmetric function analog of unimodality for the polynomials 

Of particular interest are the Qxj when the partition A consists of a 
single part. In Section it is observed that the Qxj for general A can 
be expressed via plethysm in terms of these. We present a conjectur^ 
describing the coefficients of the expansion of Qxj in the power sum 
symmetric function basis for the case that A consists of a single part. 
We also derive results on the virtual representation of the symmetric 
group whose Frobenius characteristic is Qxj for this case. 



^AU the conjectures referred to in this paragraph were recently proved jointly 
with A. Henderson. See Section [8] (New developments). 

^This conjecture has now been proved by Sagan, Shareshian and Wachs [48]. 
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The symmetric functions Qaj resemble the symmetric functions Lx 
studied by Gessel and Reutenauer in [21] in their work on quasisym- 
metric functions and permutation statistics. However our Qxj are not 
refinements of the Lx. Indeed, Lx is the Frobenius characteristic of 
a representation induced from a hnear character of the centrahzer of 
a permutation of cycle type A. On the other hand, we show that if 
A = (n), where n > 3, then Qxj is the Frobenius characteristic of a 
virtual representation (conjecturally, an actual representation) whose 
character takes nonzero values on elements that do not commute with 
any element of cycle type A (see Corollary I6.8p . 

The symmetric function on the right hand side of (11.31) and (11.41) 
refines symmetric functions that have been studied earlier in the litera- 
ture. Occurrences of these symmetric functions include enumerators for 
multiset derangements studied by MacMahon [33 Sec. Ill, Ch. Ill] and 
Askey and Ismail pQ; enumerators for words with no adjacent repeats 
studied by Carlitz, Scoville and Vaughan [TT], Dollhopf, Goulden and 
Greene [18] and Stanley [58]; chromatic symmetric functions of Stan- 
ley [58]; and the Frobenius characteristic of the representation of the 
symmetric group on the degree 2j cohomology of the toric variety Xn 
associated to the Coxeter complex of the symmetric group 6„ studied 
by Procesi [12], Stanley [57], Stembridge [611 162], and Dolgachev and 
Lunts [IT]. It is a consequence of our work that these symmetric func- 
tions have nice interpretations as sums of fundamental quasisymmetric 
functions. Representations with Frobenius characteristic Qnj also oc- 
cur in the recent paper of the authors on poset topology [51]. Indeed, it 
was our study of the homology of a certain poset introduced by Bjorner 
and Welker [5] that led us to conjecture Theorems 11.11 and 11.21 in the 
first place. These connections and others are discussed in Section [3 

2. Permutation statistics and quasisymmetric functions 

For n > 1, let (3„ be the symmetric group on the set [ra] := {1, . . . , n}. 
A permutation a G 6„, will be represented here in two ways, either 
as a function that maps i G [n] to cr(z), or in one line notation as 
a = ai . . . an, where cTj = cr(z). 

The descent set of cr G &n is 

DES((t) := {ie[n-l]:ai> a^+i}, 
and the excedance set of a is 



EXC((t) := {ie[n-l]:ai> i}. 
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Now we define the two basic Eulerian permutation statistics. The 
descent number and excedance number of a G 6„ are, respectively, 

des(a) := |DES(a)| 

and 

exc(a) := |EXC(a)|. 
For example, if cr = 32541, written in one line notation, then 

DES(a) = {1,3, 4} and EXC(a) = {1, 3}; 

hence des((j) = 3 and exc((T) = 2. If i G DES (cr) we say that a has a 
descent at i. If z G EXC((j) we say that (Xj is an excedance of a and 
that i is an excedance position. 

Next we define the two basic Mahonian permutation statistics. The 

inversion index of a G is 

inv((j) := : 1 < i < j < n and cTj > o-j}\, 

and the major index of a is 

maj(a) := ^ i. 

iGDES{cr) 

For example, if a = 32541 then inv((T) = 6 and maj((T) = 8. 

We review some basic facts of Gessel's theory of quasisymmetric func- 
tions; a good reference is pU| Chapter 7]. A quasisymmetric function 
is a formal power series /(x) = /(xi, X2, . . .) of finite degree with ratio- 
nal coefficients in the infinitely many variables xi,X2, ■ ■ ■ such that for 
any ai, . . . , Ofc G P, the coefficient of x^^ . . . x^^ equals the coefficient 
of x'^^ . . . whenever ii < ■ ■ ■ < ik and ji < ■ ■ • < jk- Thus each 
symmetric function is quasisymmetric. 

For a positive integer n and C [n — 1], define 

Fs,n = ^5,n(x) := ^ X^, . . . Xi„ 

ii > . . . > i„ > 1 

j & S ^ ij > ij+i 

and let -F0O = 1. Each Fs^n is a quasisymmetric function. The set 
{Fs^n '■ S C [n— 1], 77, G N} is a basis for the algebra Q of quasisymmetric 
functions and Fs^n is called a fundamental quasisymmetric function. If 
S* = then Fs^n is the complete homogeneous symmetric function hn 
and if S = [n — 1] then Fs^n is the elementary symmetric function e„. 

We review two important ways to specialize a quasisymmetric func- 
tion. Let Q[q] denote the ring of polynomials in variable q with co- 
efficients in Q and let Q[[q]] denote the ring of formal power series in 
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variable q with coefficients in Q. The stable principal specialization is 
the ring homomorphism ps : Q — )■ Q[[g]] defined by 



and the principal specialization of order m is the ring homomorphism 
ps^ : Q Q[g] defined by 



^ if 1 < z < m 
if z > m 



We can extend the ring homomorphism ps to a ring homomorphism 
ps : Q[[zi, Zm]] Q[[q, zi,..., Zm]] defined by 



\ni,...,n,n>0 



ni,...,nm>0 



The ring homomorphism ps^ can be similarly extended. 

Lemma 2.1 ([311 Lemma 5.2]). For all n > 1 and S [n — 1], we 

have 



(2.1) ps{Fs,n) 
and 

(2.2) 5^ps„(F5,„)p" 



plSl+lqJ^ieS ' 



m>0 



(p; (l)n 



+1 



It follows from Lemma 12.11 that 
(2.3) ps{hn) 



> (l-g)(l-g2)...(i_gn,) 

for all n and therefore 

(2.4) ps(i7(2;(l-g))) = exp^(z). 

The standard way to connect quasisymmetric functions with per- 
mutation statistics is by associating the fundamental quasisymmetric 
function -FDES(cr),n with a G (3„. By Lemma |2TT| we have for any subset 
AG 6„ 

/ \ 1 

maj(o-) 



and 



5^ PS„ FDES(.),n = 5^ 

m>0 \<xGA / ^^"+1 <7GA 



^dcs(o-)+l^maj(o-) 
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Gessel and Reutenauer [3l] used this to study the (maj , des)-enumerator 
for permutations of a fixed cycle type. 

Here we introduce a new way to associate fundamental quasisym- 
metric functions with permutations. For n > 1, we set 

[n] := {T, . . . ,n} 

and totally order the alphabet [n] U [n] by 

(2.5) T<...<rr<l<...<?T.. 

For a permutation a = cri . . . (t„ G &n, we define a to be the word over 
alphabet [n] U [n] obtained from a by replacing o"j with o7 whenever 
i G EXC((t). For example, if a = 531462 then a = 531462. We define 
a descent in a word w = wi . . . Wn over any totally ordered alphabet to 
be any z G [jt- — 1] such that Wi > w^i+i and let DES(w) be the set of all 
descents of w. Now, for a G &n, we define 

DEX((t) := DES(ct). 

For example, DEX(531462) = DES(531462) = {1,4}. 

Lemma 2.2. For all a G ©„, 

(2.6) i = maj (a) — exc(cr), 

jeDEX((T) 

and 

(2.7) \mx(a)i = H;] , fw:; 

(^des((T) - 1 ifa{l)^l 

Proof. Let 

J{a) = {ze[n-l]:i^ EXC(a) & z + 1 G EXC(a)}, 

and let 

K{a) = {t e[n-l]:t e EXC(a) & i + 1 ^ EXC{a)}. 

If i G J(cr) then ^(i) < i < i + 1 < (T(i + 1). Hence i ^ DES(cr), 
but i G DEX((t). If i G K{a) then cr(i) > i + 1 > a(i + 1). Hence 
i G DES(a), but i ^ DEX(a). It follows that K{a) C DES(a) and 

(2.8) DEX((t) = (DES(a) W /(a)) - K{a). 
Hence 

(2.9) |DEX(a)| = des(cr) + \J{a)\ - \K{a)\. 

Let J{a) = {ji <32 < ■■■ < Jt} and K{a) = {ki < k2 < ■ ■ ■ < ks}. 
It is easy to see that ii a{l) = 1 then t = s and 

(2.10) Ji < h < J2 < k2 < ■ ■ ■ < Jt < h, 
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since neither 1 nor n are excedance positions. On the other hand if 
cr(l) 7^ 1 then s = t + 1 and 

(2.11) h < ji < k2 < ]2 < ■ ■ ■ < 3t < kt+i. 

It now follows from (EH) that (1221) holds. 

To prove (12. 6p . we again handle the cases a{l) = 1 and a(l) 7^ 1 
separately. 

Case 1: Suppose a(l) = 1. Then (^JO\f holds. By (EH), 

f 

J2 

iGDEX((T) jGDES(t7) i=l 

Clearly 

t 

EXC{a) = \^{j, + l,ji + 2,...,ki}. 

i=l 

Hence 

t 

exc(cr) = ^{h-ji) 

1=1 

and so (12.61) holds in this case. 

Case 2: Suppose a{l) ^ 1. Now fimi) holds. By (TO . 

^ z = ^ z - fci - ^(fci+l - ji). 

jGDEX(o-) iGDES((T) i=l 

Now 

t 

EXC((t) = {1, 2, . . . , W + 1, J, + 2, . . . , A;,+i}, 

1=1 

which implies that 

t 

exc(a-) = /ci + ^(Aji+i - ji). 

i=l 

Hence (12.61) holds in this case too. □ 

We now define the quasisymmetric functions that play a central role 
in this paper. Let n > 1, j, k > and A h n. The Eulerian quasisym- 
metric functions are defined by 

Qn,j = Qn,j{^) '■= ^ -^DEX(<T),n(x). 
exc(cr) = j 
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The fixed point Eulerian quasisymmetric functions are defined by 

Qn,j,k = Qn,i,k{^) '■= ^ -FDEX(<T),n(x). 

O- G 6n 

exc((j) = j 
fix((7) = k 

The cycle type Eulerian quasisymmetric functions are defined by 

QaJ = <5A,j(x) := ^ -^DEX(<T),n(x), 

exc(cr) = j 
X{a) = A 

where A(cr) denotes the cycle type of a. For convenience we set [0] = 
and ©0 = {6*}, where 9 denotes the empty word, and let DEX(6') = 
DES(e) = EXC(e) = and exc(^) = fix(e) = des(^) = maj(e) = 0. So 
Qo,o,o = 1- Also set X{6) equal to the empty partition of 0. 

Remark 2.3. It is a consequence of Theorem 11.21 that the Eulerian 
quasisymmetric functions Qn,j and Qn,j,k are symmetric functions. We 
prove in Section 15.21 that the refinement Qaj is symmetric as well. 

Next we define various versions of g, p-analogs of the Eulerian num- 
bers 

an,j ■.= \{a e&n- exc(o-) = 
Let n, j, /c > 0. The {q^p)- Eulerian numbers are defined by 

cr e e„ 

exc(cr) = j 

and the fixed point {q,p)- Eulerian numbers are defined by 

o- G 6„ 
exc(cr) = j 
fix((j) = k 

For n,j > and A h n, the cyc/e tyj>e {q,p)- Eulerian numbers are 
defined by 

a^^j{q,p)= Y 

cr G ©n 

exc(o-) = j 
\{a) = A 

It follows from (12.11) and (12. 61) that for cr G ©„ we have 
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Hence 

(2.12) a„j,fc(g, 1) = (q; q)nPs{Qn,j,k), 

(2.13) aA,i(g, 1) = q^{q]q)nPs{Q\,j). 

Proof of Corollary \1.3\. From equations ( ]2.12p and ( I2.4p . we see that 
Corollary 11.31 is obtained from Theorem 11.21 by first replacing z by 
z{l — q) in f ll.3p and then applying the stable principal specialization 
ps to both sides of the resulting equation. □ 

The (nonstable) principal specialization is a bit more complicated. 
Given two partitions A h n and /i h m, let (A,/i) denote the partition 
of n + m obtained by concatenating A and /i and then appropriately 
rearranging the parts. 

Lemma 2.4. For < j, k < n, let X\- n — k, where A has no parts of 
size 1. Then 

k 

a[x,ik),j{q,p) = (p; q)n+i^p"'^q'"'^^ps^{Q[x,ik-^)j)- 

m>0 i=0 

Consequently, for n,j, k > 0, 

k 

an,j,k{q^P) = ip-,q)n+l'^p"''^q'"'^^pSm{Qn-iJ,k-i)- 

Proof. For all a G where n > 0, we have, by (12. 2 p and Lemma [2. 2 [ 
It follows that 

(2.14) Yl P«.n(Q(A,lM,.K = ^A,,(9,P), 

m>0 

where 

[Pi Q)n+1 

(J € &„ 
exc(o") = j 
A(a) = (A,l'=) 
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when n > 0, and X^j(q,p) = when n = 0. By fl2.7p we have 

X^.{q,p) = V gmaj(a)-jpdesM+l 

exc((j) — j 
a(l) = l 



{P; (l)n+l 



^maj((T)-j^dcs((7) 



exc(cr) = j 
a(l)/l 



Let 



exc{a) = j 
A(a) = (A,l^-) 
a(l) = 1 

Write a^j{q,p) for a(;^ ifc)j(g,p). We have 

(2.15) = 

Let (p : {a E (3„ : cr(l) = 1} — )■ &n-i be the bijection defined by 
letting ifia) be the permutation obtained by removing the 1 from the 
beginning of a and subtracting 1 from each letter of the remaining word. 
It is clear that maj((j) = ma.}{(p{a)) + des((j), des(cr) = des{(p{a)), 
exc(cr) = exc{(p{a)) and fix{a) = fix{ip{a)) + 1. Hence 

^ q^{p;q)n+i 

Plugging this into ( 12.15P yields the recurrence 



q^{p]q)n+i q^{qp\q)r 

By iterating this recurrence we get 



The result now follows from fl2.16p and (12.140 . □ 
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Proof of Corollary \1.4\ By Lemma 12.41 and Theorem \1.2\ we have 



n>0 



n,j,k>0 

fc 

E ^-tV'^ E E ?'"^+'PS™(Qn-.,,,fc-.) 
n,j,k>0 m>0 i=0 

Ep'"E(^^^'")' E PS™(Qn-.,,fc-.)(gt)^r'=-^"- 

m>0 i>0 n,k>i 

^ p"' f (l- tq)H{zr) 



zrg'" ™ \H{ztq) -tqH{z) 



m>0 

{{z]q)m-tq{ztq]q)m){zr]q)m+i 



{l-tq){z;q)miztq;q) 

r 



with the last step following from 

ps„.(/fW)=ps„(nT^) = (^), 



□ 



3. BiCOLORED NECKLACES AND WORDS 

In this section we prove Theorem ll.2[ There are three main steps. 
In the first step (Section 13.11) we modify a bijection that Gessel and 
Reutenauer [31] constructed in order to enumerate permutations with 
a fixed descent set and fixed cycle type. This yields an alternative 
characterization of the Eulerian quasisymmetric functions in terms of 
bicolored necklaces. In the second step (Section 13. 2p we construct a bi- 
jection from multisets of bicolored necklaces to bicolored words, which 
involves Lyndon decompositions of words. This yields yet another char- 
acterization of the Eulerian quasisymmetric functions. In the third step 
(Section 13. 3p we generalize a bijection that Stembridge constructed to 
study the representation of the symmetric group on the cohomology 
of the toric variety associated with the type A Coxeter complex. This 
enables us to derive a recurrence relation, which yields Theorem 11.21 
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3.1. Step 1: bicolored version of the Gessel-Reutenauer bijec- 

tion. The Gessel-Reutenauer bijection (see [21]) is a bijection between 
the set of pairs (a, s), where a is a permutation and s is a "compati- 
ble" weakly decreasing sequence, and the set of multisets of primitive 
circular words over the alphabet of positive integers. This bijection 
enabled Gessel and Reutenauer to use the fundamental quasisymmet- 
ric functions FY)ES{a),n to study properties of permutations with a fixed 
descent set and cycle type. Here we introduce a bicolored version of 
the Gessel-Reutenauer bijection. 

We consider circular words over the alphabet of bicolored positive 
integers 

{1,1,2,2,3,3,...}. 

(We can think of "barred" and "unbarred" as colors assigned to each 
positive integer.) For each such circular word and each starting posi- 
tion, one gets a linear word by reading the circular word in a clockwise 
direction. If one gets a distinct linear word for each starting position 
then the circular word is said to be primitive. For example the circular 
word (1, 1, 1) is primitive while the circular word (1, 2, 1, 2) is not. (If w 
is a linear word then (w) denotes the circular word obtained by placing 
the letters of w around a circle in a clockwise direction.) The absolute 
value or just value of a letter a is the letter obtained by ignoring the 
bar if there is one. We denote this by \a\. The size of a circular word 
is the number of letters in the word (counting multiplicity). 

Definition 3.1. A bicolored necklace is a primitive circular word w 
over alphabet A such that if the size of w is greater than 1 then 

(1) every barred letter is followed (clockwise) by a letter less than 
or equal to it in absolute value 

(2) every unbarred letter is followed by a letter greater than or 
equal to it in absolute value. 

A circular word of size 1 is a bicolored necklace if its sole letter is 
unbarred. A bicolored ornament is a multiset of bicolored necklaces. 

For example the following circular words are bicolored necklaces: 

(3, 1, 3, 3, 2, 2), (3, 1, 3, 3, 2, 2), (3, 1, 3, 3, 2, 2), (3, 1, 3, 3, 2, 2), (2), 

while (3, 1, 3, 3, 2, 2) and (3) are not. 

From now on we will drop the word "bicolored"; so "necklace" will 
stand for "bicolored necklace" and "ornament" will stand for "bicolored 
ornament". The type A(i?) of an ornament R is the partition whose 
parts are the sizes of the necklaces in R. The weight of a letter a is the 
indeterminate x\a\- The weight wt(i?) of an ornament R is the product 
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and 



wt((3,2,2),(3,2,l,l,2)) = x2x^x2. 



For each partition A and nonnegative integer j, let be the set of 
ornaments of type A with j bars. 

Given a permutation a G &n, we say that a weakly decreasing se- 
quence Si > S2 > ■ ■ ■ > s„ of positive integers is a-compatible if 
Si > Sj+i whenever i G DEX(cr). For example, 7,7,7,5,5,4,2,2 is 
a-compatible, where a = 45162387. Note that for all a G ©„, 



where si, . . . , s„ ranges over all a-compatible sequences. 

For X\- n and j = 0, . . . , — 1, let Com^j be the set of pairs (a, s), 
where a is a permutation of cycle type A with j excedances and s is a 
a-compatible sequence. Let (p : Com^j- — )■ 9^aj be the map defined by 
letting (f){a, s) be the ornament obtained by first writing a in cycle form 
with bars above the letters that are followed (cyclicly) by larger letters 
(i.e., the excedances) and then replacing each i with Si, keeping the 
bars in place. For example, let a = 45162387 and s = 7, 7, 7, 5, 5, 4, 2, 2. 
First we write a in cycle form. 



Next we put bars above the letters that are followed by larger letters. 



Theorem 3.2. The map (p : Com.\j — )■ Vixj is a well-defined bijection. 

Proof. Let (a, s) G Com^j-. It is clear that the circular words in the 
multiset 0(a, s) satisfy conditions (1) and (2) of Definition 13. II and that 
the number of bars of 0(a, s) is j. It is also clear that A(0(a, s)) = A. 

We must now show that the circular words in 0(a, s) are primitive. 
Suppose there is a circular word (oj^, . . . , Oj^) that is not primitive. 
Let this word come from the cycle {ii,i2, ■ ■ ■ lik) of a, where ii is the 
smallest element of the cycle. Suppose Ui^^, . . . , aii, = (oj^, . . . aj^)^/"^, 
where d < k. Since a^^ = ctj^^j, ii < id+i, and the |ai|'s form a 
weakly decreasing sequence, it follows that |aj| = |ajj for all i such 
that ii < i < id+i- Hence since (|ai|, |a2|, . . . , |an|) is a-compatible. 





a = (l,4,6,3)(2,5)(7,8). 
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there can be no element of DEX(cr) in the set {ii, ii + 1, . . . , id+i — !}• 
Since and Cj^^^ are equal, they are both barred or both unbarred. 
(Actually, is barred since ii is the smallest element of its cycle, but 
since we repeat this argument for ^2 in the next paragraph, we don't 
want to use this fact.) It follows that both ii and i^+i are excedance 
positions or both are not. Hence since no element of DEX((t) is in 
{zi, zi + 1, . . . , id+i - 1}, we have 

cr(zi) < a{ii + 1) < ■ ■ ■ < 

Since cr{ii) = 12 and a{id+i) = id+2 "we have 12 < id+2- Repeated 
use of the above argument yields < id+3 and eventually ik+i^d < h, 
which is impossible since ii is the smallest element of its cycle. Hence 
all the circular words of (j){a, s) are primitive and (j){a, s) is an ornament 
of type A with j bars, which means that (p is well-defined. 

To show that </> is a bijection, we construct its inverse rj : 9^A,j — > 
Com^j, which takes the ornament R to the pair {a{R), s{R)). Here 
s{R) is simply the weakly decreasing rearrangement of the letters of 
R with bars removed. To construct the permutation cr{R), we need to 
first order the alphabet A by 

(3.1) 1<1<2<2<.... 

Note that this ordering is different from the ordering (12. 5p of the finite 
alphabet that was used to define DEX. 

For each position x of each necklace of R, consider the infinite word 
Wx obtained by reading the necklace in a clockwise direction starting 
at position x. Let 

Wx <L Wy 

mean that Wx is lexicographically less than or equal to Wy. We use the 
lexicographic order on words to order the positions: if Wx <l Wy then 
we say x < y. We break ties as follows: if Wx = Wy and x ^ y then x and 
y must be positions in distinct (but equal) necklaces since necklaces are 
primitive. If Wx = Wy and x is a position in an earlier necklace than that 
of y under some fixed linear ordering of the necklaces then let x < y. 
With this ordering on words in hand, if x is the ith largest position 
then replace the letter in position x by i. We now have a multiset 
of circular words in which each letter 1, 2, . . . , n appears exactly once. 
This is the cycle form of the permutation a{R). 
For example, if 

i?= ((7, 3, 3, 5), (7, 3, 5, 3), (7, 3, 5, 3), (5)), 

then 

a{R) = (1, 8, 13, 6), (2, 11, 4, 9), (3, 12, 5, 10), (7) 
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and 

s{R) = 7, 7, 7, 5, 5, 5, 5, 3, 3, 3, 3, 3, 3. 

It is not hard to see that the letter in position x of i? is barred if and 
only if the letter that replaces it is an excedance position of a{R). This 
implies that the number of bars of R equals the number of excedances 
of a(i?). 

Now we show that s{R) is (7(i?)-compatible. Suppose 

s{R)i = s{R)i+i. 

We must show i ^ DEX(cr(-R)). Let x be the ith largest position of R 
and let y be the {i + l)st largest. Then i is placed in position x and 
2 + 1 is placed in position y. Let /(w) denote the first letter of a word 
w. Then one of the following must hold 

(1) f{W^) = S{R), = fjWy) 

(2) f{w,) = s{R), = fjwy) 

(3) /(wx) = s{R)i and f{wy) = s{R)i . 

Cases (1) and (2): Either Wx >l Wy or Wx = Wy and x is in an earlier 
necklace than y. Let u be the position that follows x clockwise and let 
V be the position that follows y. Since Wu is the word obtained from Wx 
by removing its first letter, is obtained from Wy by removing its first 
letter, and the first letters are equal, we conclude that u > v. Hence 
the letter that gets placed in position u is smaller than the letter that 
gets placed in position v. Since the letter placed in position u is a{R){i) 
and the letter placed in position v is a{R){i + 1), we have a{R){i) < 
a{R){i + 1). Since + EXC(a(i?)) or z, z + 1 ^ EXC{a{R)), we 
conclude that i ^ DEX(cr(i?)). 

Case (3): Since the letter in position x is barred we have i G 
EXC(cr(-R)). Since the letter in position y is not barred, we have 
i + EXC(a(i?)). Hence i i DEX(a(i?)). 

In all three cases we have that s[R)i = s{R)i+i implies i ^ DEX{a{R)). 
Hence s{R) is cr(-R)-compatible. 

Now we show that the map t] is the inverse of </>. It is easy to see 
that (j){r}{R)) = R. Establishing 77(0(0", s)) = (a, s) means estabhshing 
a{(f){a,s)) = a and s(0(o", s)) = s. The latter equation is obvious. To 
establish the former, let R = (j){a,s). Recall that R is obtained by 
writing a in cycle form, barring the excedances, and then replacing 
each i by Si, keeping the bars intact. Let pi be the position that i 
occupied before the replacement. By ordering the cycles of a so that 
the minimum elements of the cycles increase, we get an ordering of the 
necklaces in R, which we use to break ties between the Wp. To show 
that cr{R) = a, we need to show that 
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(1) if i < j then Wp, >l Wp^ 

(2) if i < j and Wp^ = Wp. then z is in a cycle whose minimum 
element is less than that of the cycle containing j. 

To prove (1) and (2), we will use the following implication: 

(3.2) i < j and U7p, <l Wp^ =^ fi^p.) = f{wp^) and a{i) < a{j), 

(Recall fiw) is the first letter of a word w.) 

Proof of (13.21) : Since i < j and s is weakly decreasing, we have 
Si > Sj. Since Wp^ <l Wp^, we have f{wp.) < f{wp^), which implies 
that Sj < Sj. Hence Sj = Sj, which implies 

Si "Sj+l ■ ■ ■ Sj. 

It follows from this and the fact that s is a-compatible that k ^ DEX((t) 
for all /c = 2, i + 1, . . . , j — 1. This implies that either 

i,i + 1, . . . ,j e EXC(cr) and a{i) < a{i + 1) < ■ ■ ■ < a{j) 

or 

i,i + 1, . . . J ^ EXC((t) and a{i) < a{i + 1) < ■ ■ ■ < a{j) 

or 

i G EXC(a) and j ^ EXC(c7). 

In the first case, f{wp^) = Si = Sj = f{wp.). In the second case, 
fi.'^Pi) = Si = Sj = f{wp^). In the third case f{wp^) = Si > Si = Sj = 
f{wp^), which is impossible. Hence the conclusion of the implication 
'holds. 

Now we use (13. 2p to prove (1). Suppose i < j and Wp. <l Wp.. 
Then by (13.21) . we have a{i) < a{i) and f{wp-) = f{wp^), which im- 
plies Wp^(.) <L '^Pau)' Hence we can apply (13. 2p again with a{i) and 
cr(j) playing the roles of i and j. This yields f{wp^^^^^) = f{wp^^^^^), 
cr^(i) < <J^{j), and Wp^^^_^ <l Wp^^^,y Repeated application of (13.21) 
yields f{wp^„,^^^) = f{wp^^^^^) for all m, which implies Wp^ = Wp^, a 
contradiction. 

Next we prove (2). Repeated application of (13.21) yields cr™'(z) < 
(y^{j) for all m. Hence the cycle containing i has a smaller minimum 
than the cycle containing j. □ 

Corollary 3.3. For all \ \- n and j = 0, 1, . . . , n — 1, 
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Corollary 13.31 has several interesting consequences. For one thing, it 
can be used to prove that the Eulerian quasisymmetric functions Qxj 
are actually symmetric (see Section [5]). It also has the following useful 
consequence. 

Corollary 3.4. For alln,j,k, 

Qn,j,k hkQiri—k,j,0- 

It follows from Corollary 13.41 that Theorem 11.21 is equivalent to 
We rewrite this as, 

n,j>0 n>2 

which is equivalent to 

n,j>0 n>2 J > 

< m < n - 2 

For rz > 2, we have 

j+n—m—l 

Qm,jfl't''^^[lT- ~ TTT' ~ Mthn-m = Qmjflhn-m 

j >0; j > i=J+l 

0<m<n-2 0<m<n-2 

^ ^ ^ ^ ^ Qm,j,0^n—m 

i>0 < m < n - 2 
i — n + m<j<i 

Hence Theorem 11.21 is equivalent to the recurrence relation 

(3.3) Qn,j,0 ~ ^ ] Qm,i,ohn—my 

0<m<n-2 
j+m~n<i<j 

for n > 2 and j > 0. 

3.2. Step 2: banners. In order to establish the recurrence relation 
(13.31) . we introduce another type of configuration, closely related to 
ornaments. 

Definition 3.5. A banner is a word B over alphabet A such that the 
last letter of B is unbarred and for alH = 1, . . . , i{B) — 1, 
(1) if B{i) is barred then \B{i)\ > \B{i + 1)| 
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(2) if B{i) is unbarred then \B{{)\ < \B{i + 1)|, 

where B{i) denotes the ith letter of B and i{B) denotes the length of 
B. 

A Lyndon word over an ordered alphabet is a word that is strictly 
lexicographically larger than all its circular rearrangements. A Lyndon 
factorization of a word over an ordered alphabet is a factorization into 
a weakly lexicographically increasing sequence of Lyndon words. It is 
a result of Lyndon (see ^Ti Theorem 5.1.5]) that every word has a 
unique Lyndon factorization. The Lyndon type X{w) of a word w is 
the partition whose parts are the lengths of the words in its Lyndon 
factorization. 

To apply the theory of Lyndon words to banners, we use the ordering 
of A given in ( 13. ip . Using this order, the banner B := 22757547 has 
LjTidon factorization 

22 ■ 75 ■ 7547. 

So the Lyndon type of B is the partition (4, 2, 2). 

The weight wt{B) of a banner B is the product of the weights of 
its letters, where as before the weight of a letter a is x\a\. For each 
partition A and nonnegative integer j, let 03 be the set of banners 
with j bars whose Lyndon type is A. 

Theorem 3.6. For each partition A and nonnegative integer j , there 
is a weight-preserving bijection 

Consequently, 

Proof. First note that there is a natural weight-preserving bijection 
from the set of Lyndon banners of length n to the set of necklaces of 
size n. To go from a Lyndon banner B to a necklace (B) simply attach 
the ends of B so that the left end follows the right end when read in 
a clockwise direction. To go from a necklace back to a banner simply 
find the lexicographically largest linear word obtained by reading the 
circular word in a clockwise direction. The number of bars of B clearly 
is the same as that of (B). 
Let B e ^x,j and let 

B = Bi ■ B2 - ■ ■ Bk 

be the unique Lyndon factorization of B. Note that each Bi is a Lyndon 
banner. To see this we need only check that the last letter of each Bi 
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is unbarred. The last letter of Bk is the last letter of B; so it is clearly 
unbarred. For i < k, the last letter of Bi is strictly less than the first 
letter of B^, which is less than or equal to the first letter of -Bj+i. Since 
the last letter of Bi immediately precedes the first letter of -Bi+i in the 
banner B, it must be unbarred. 

Now define ip{B) to be the ornament whose necklaces are 

(i?l),(i?2),...,(i?fc). 

This map is clearly weight preserving, type preserving, and bar pre- 
serving. To go from an ornament back to a banner simply arrange the 
Lyndon banners obtained from the necklaces in the ornament in weakly 
increasing lexicographical order and then concatenate. □ 

3.3. Step 3: the recurrence relation. Now we prove the recurrence 
relation (13. 3p , which we have shown is equivalent to Theorem 11.21 It is 
convenient to rewrite (13.31) as 

(3.4) Qn,,o= Yl Q 

< m < n - 2 

1 < b < n — m 

Define a marked sequence (cj, h) to be a weakly increasing finite se- 
quence uj of positive integers together with an integer h such that 
1 < 6 < lengthiu). (One can visualize this as a weakly increasing 
sequence with a mark above one of its elements other than the last.) 
For n > 2, let be the set of marked sequences of length n. For 
77, > 0, let ®° be the set of banners of length n whose Lyndon type has 
no parts of size 1. It will be convenient to consider the empty word 
to be a banner of length 0, weight 1, with no bars, and whose Lyndon 
type is the partition of with no parts. So 53o consists of a single 
element, namely the empty word. Note that ®5 is the empty set. 

Theorem 13.61 and Theorem 13.71 below suffice to establish the recur- 
rence relation (13. 4p . Indeed, by Theorem 13.61 the monomial terms on 
the left of (13.41) are the weights of banners in with j barred let- 
ters. By Theorem 13.71 these banners correspond bijectively to pairs 
(5', (cj, b)) such that B' G has j — h barred letters, (cj, h) G 9Jt,i_m, 
and wt(-B')wt(ci;) equals the weight of the corresponding banner in 
23°. Since the monomial terms of hn-m are the weights of weakly 
increasing sequences of length n — m, we have that the monomial 
terms of Qm,j-b,ohn-m in the sum on the right of (13. 4p are also of 
the form wt(i?')wt(a;), where B' G 53^ has j — b barred letters and 

(W, b) G Tln-m- 
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Theorem 3.7. For all n > 2, there is a bijection 
7 : «° l+l ®^ X Tln-^, 

0<m<n~2 

such that if'-f{B) = (B', {u},b)) then 

(3.5) wt(fi) = wt(fi')wt(w) 
and 

(3.6) bar(5) = bar(5') + b, 
where bar(i?) denotes the number of bars of B. 

We will make use of another type of factorization of a word over 
an ordered alphabet used by Desarmenien and Wachs [15]. For any 
alphabet A, let denote the set of words over A of positive length. 

Definition 3.8 ([I5]). An increasing factorization of a word w of 
positive length over a totally ordered alphabet A is a factorization 
w = wi ■ W2 ■ ■ ■ Wk such that 

(1) each Wi is of the form afui, where Oj G A, ji > and 

Ui & {x E A : X < Qi}^ 

(2) ai < a2 < ■ ■ ■ < ak- 

For example, 87 ■ 8866 ■ 995587 ■ 95 is an increasing factorization 
of the word w := 87886699558795 over the totally ordered alphabet 
of positive integers. Note that this factorization is different from the 
Lyndon factorization of w, which is 87 ■ 8866 ■ 99558795 

Proposition 3.9 ( [T^ Lemmas 3.1 and 4.3 ])• A word over an ordered 
alphabet admits an increasing factorization if and only if its Lyndon 
type has no parts of size 1. Moreover, the increasing factorization is 
unique. 

Proof of Theorem 3.1. Given a banner B in *B[^, take its unique in- 
creasing factorization 

B = Bi ■ B2 ■ ■ ■ Bk, 

whose existence is guaranteed by Proposition 13. 9[ We will extract an 
increasing word from Bk- We have 

Bk = a^ii ■■■ii, 

where p,l > 1, and a > ii,i2, ■ ■ ■ For convenience set io = a. It fol- 
lows from the definition of banner that a is a barred letter. Determine 
the unique index r such that ii > ■ ■ ■ > V-i are barred, while v is 
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unbarred. Then let s be the unique index that satisfies r < s < I and 
either 

(1) ir < v+1 < ■ ■ ■ < "^s are all unbarred and less than v_i (note 
that is can be equal to V-i in absolute value), while ig+i > V-i 
if s < /, or 

(2) V < V+i < ■ ■ ■ < "^s-i are all unbarred and less than ir-i, and 
is is barred and less than or equal to V-i- 

Case 1: s = I. In this case (1) must hold since the last letter of a 
banner is unbarred. Let u be the weakly increasing rearrangement of 
with bars removed and let 

(3.7) B' = Bi-B2---Bk-i. 

To see that B' is a banner, one need only note that the last letter of 
Bk-i is unbarred (as is the last letter of each Bi). Since (13.71) is an 
increasing factorization of B', it follows from Proposition 13.91 that the 
Lyndon type of B' has no parts of size 1. Let 

7(5) = (fi',(u;,6)), 

where b is the number of bars of B^. Clearly p < b < p + I; so {u, b) is 
a marked sequence for which (13. 5p and (13. 6p hold. For example, if 

B = 2221 ■ 52242 ■ 88752235. 

then a = 8, p = 2,r = 3 and s = 6 = /. It follows that 

{uj,b) = (22355788,4) and B' = 2221 ■ 52242. 

Case 2: s < I. In this case either (1) or (2) can hold. Let b be 
the number of bars of ii,22, ■ ■ ■ ,is- Clearly b < s. If (1) holds then 
r > 1 since is+i > ir-i', so b > 0. If (2) holds clearly b > 0. Let u 
be the increasing rearrangement of ii, • • • , "is with bars removed, let 
Bl = a^is+i ■■■ii, let 

(3.8) B' = Bi ■ B2 ■ ■ ■ Bk-i ■ B'l^, 
and let 

^{B) = iB',iu,b)). 
Clearly B' is a banner with increasing factorization given by (13.81) and 
(w, b) is a marked sequence for which (13. 5p and (13.60 hold. For example, 
if 

B = 2221 ■ 52242 ■ 88752235624 
then a = 8, p = 2, r = 3, and s = 6 < /. Hence 

(w, b) = (223557, 2) and B' = 2221 ■ 52242 ■ 88624. 

If 

B = 2221 ■ 52242 ■ 887522354624 
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then a = 8, p = 2, r = 3, and s = Q < I. Hence 

(w, b) = (223557, 3) and B' = 2221 ■ 52242 ■ 884624. 

In order to prove that the map 7 is a bijection, we describe its inverse. 
Let {B', (w, b)) e 53^ X m^-m, where < m < n - 2. Let 

B' = Bi ■ B2 - ■ ■ Bk-i 

be the unique increasing factorization of B', whose existence is guar- 
anteed by Proposition 13.91 and let a be the largest letter of -Bfc-i- We 
also let uji denote the ith letter of u. 
Case 1: \a\ < Un-m- Let 

Clearly Bk is a banner with exactly b bars that are placed on a re- 
arrangement of u. Now let 

B = Bi ■ B2 - ■ ■ Bk-i ■ Bk- 

It is easy to see that this is an increasing decomposition of a banner 
and that equations (13.51) and (13. 6p hold. 

Case 2: \a\ > Un-m- In this case we expand the banner Bk-i by 
inserting the letters of u in the following way. Suppose 

Bk^i = a^ji ■■■iu 
where p, / > 1, and a > ji for all i. If ji > Un-m-b+i let 

Bk-l = oFijJn-m ■ ■ ■ ^n-m-b+l^l " " " <^n-m-bjl, ■ ■ ■ ,jl- 

Otherwise if ji < Un-m-b+i let 

Bk-l = O'^^n-m ■ ■ ' ^n-m.~b+2^1 " " ' ^n-m-b '^n-m-b+ljli ■ ■ ■ ijl- 

In both cases Bk-i is a banner. Now let 

B = Bi ■ B2 - ■ ■ Bk-2 ■ -Bfc-i- 

It is easy to see that this is an increasing decomposition of a banner 
and that equations (13. 5p and (13. 6p hold. It is also easy to check that 
the map {B', [u, b)) i? is the inverse of 7. □ 

Remark 3.10. The bijection 7 when restricted to banners with distinct 
letters (permutations) reduces to a bijection that Stembridge [M] con- 
structed to study the representation of the symmetric group on the 
cohomology of the toric variety associated with the type A Coxeter 
complex (see Section [6]). For words with distinct letters, the notions 
of decreasing decomposition and Lyndon decomposition coincide. In 
[61] the Lyndon decomposition corresponds to the cycle decomposition 
of a permutation, and marked sequences are defined differently there. 
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There is, however, a close connection between our notion of marked 
sequences and Stembridge's. 

Remark 3.11. In Section[7]we discuss a connection, pointed out to us by 
Richard Stanley, between banners and words with no adjacent repeats. 
This connection can be used to provide an alternative to Step 3 in our 
proof of Theorem II. 2[ 

4. Alternative formulations 

In this section we present some equivalent formulations of Theo- 
rem [L2] and some immediate consequences. 



Corollary 4.1 (of Theorem O]). Let Qn{t,r) = Ej,k>oQn,j,kP 
Then Qnit,r) satisfies the following recurrence relation: 



k 



n-2 



(4.1) g„(t, r) = r"/i„ + J2 Qk{t. r)hrr-kt[n -k- l]t. 

k=0 

Proof. The recurrence relation is equivalent to 



^Qk{t,r)hn-kt[n - k - l]t = -r'^hn, 



k=0 



where [— 1]^ := — t ^. Taking the generating function we have 
J2Qn{t,r)zA (^M[n-l]t^") =-H{rz). 

Kn>0 J \n>0 J 

The result follows from this. □ 

The right hand side of (11. 3p is the Frobenius characteristic of a graded 
permutation representation that Stembridge [HI] described in terms of 
&n acting on "marked words". From his work we were led to the 
following formula, which can easily be proved by showing that the 
right hand side satisfies the recurrence relation (14.11) . 

Corollary 4.2. For all n >0, 

(4.2) Qn{t,r) = J2 J2 r'°KllhkAh-l]t. 

"^=0 fco > «=1 
ki , . . . , hm ^ 2 

Let 
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By taking the principal stable specialization of both sides of the re- 
currence relation f l4.ip and the formula ( I4.2p . we have the following 
result. 

Corollary 4.3. For all n > 0, 



n-2 



and 



k=0 



n 
k 



tqi 



n 

koi ■ ■ ■ } km 



l[tq[k,-l]tg. 



i=l 



'"=0 fco > 

Gessel and Reutenauer [31] and Wachs [M] derive a major index q- 
analog of the classical formula for the number of derangements in (3„ 
(or more generally the number of permutations with a given number 
of fixed points). As an immediate consequence of |SH Corollary 3], one 
can obtain a (maj,exc) generalization. Since this generalization also 
follows from Corollary 11.31 and is not explicitly stated in [61], we state 
and prove it here. For all G N, let Vn be the set of derangements in 

Corollary 4.4 (of Corollary II. 3p . For all < k < n, we have 



(4.3) 



^maj(tT)^exc((T) 



fix((7) = k 



n 
k 



^maj(tT)^exc((T) 



1 a&V„ 



Consequently. 
(4,4) 



maj((7)^exc(o') 



fc=0 



n 



Proof. Since the left hand side of (14. 3 p equals the coefficient of '"'^■[fj"! 
on the left hand side of (II. 5p . we have that the left hand side of (14. 3 p is 

times the coefficient of , in {l—tq)/{expg{ztq)—tqexpg{z)). 

This coefficient is precisely Xlo-eo j. q^^^^'^H°^'^^°'\ 

By summing (14.30 over all k and applying Gaussian inversion we 
obtain □ 



n 
k 
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We point out that our results pertaining to major index have comajor 
index versions. We define comajor index of a G ©„ to be 



comaj (a) := i 

ie[n-l]\DES(cr) 



n 



maj(crj 



(Note that this is different from another commonly used notion of coma- 
jor index.) For example, we have the following comajor index version 
of Corollary 11.31 



Corollary 4.5 (of Corollary II. 3p . We have 

(1 - tg-^)Exp (r^) 

"' ' r I— — 7 = — 

' MnlJ Exn I 

n>0 



(4.5) ^Ar^j'<=-'fi-(g,t,r) — 



Exp rztg-1) - (tg-i)Exp rz) 



Proof. Use the facts that = q ^^^[n]q\ and expg-i(2;) = Expg(z) 

to show that equations (II. 5p and ( 14. 5p are equivalent. □ 



We also have the following comajor index version of Corollary 14.41 
Corollary 4.6. For all < k < n, we have 



E 



^comaj(o-)^cxc((T) _ ^(j) 



fix((7) = k 

Consequently, 



n 
k 



^comaj(o-)^cxc((T) 



1 <tGX5„_ 



2.^ 



comaj (it) ^cxc((t) 



fc=0 



n 
A; 



<°_T'-=(g,t). 



5. Symmetry and unimodality 

5.1. Eulerian quasisymmetric functions. It is well known that 
the Eulerian numbers a„j form a symmetric and unimodal sequence 
for each fixed n (see [131 P- 292]); i.e., a„j = an,n-i~j for all j = 
0, 1, . . . , — 1 and 

In this subsection we discuss symmetry and unimodality of the coef- 
ficients of P in the Eulerian quasisymmetric functions and the q- and 
(g, p)-Eulerian polynomials. 

Let fit) := frt"^ + fr+it^~^^ + ■ ■ ■ + fst^ be a nonzero polynomial in t 
whose coefficients come from a partially ordered ring R. We say that 
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f{t) is t- symmetric with center of symmetry if fr+i = fs-i for all 
i = 0, . . . , s — r. We say that f{t) is also t-unimodal if 

(5.1) fr <R fr+l </? ■ ■ ■ <_R /[^J = >/? " " ' >iJ >/? /s- 

Let Par be the set of all partitions of all nonnegative integers. By 
choosing a Q-basis b = {b\ : A G Par} for the space of symmetric 
functions, we obtain the partial order relation on the ring of symmetric 
functions given hj f <b g if g — f is 6-positive, where a symmetric 
function is said to be 6-positive if it is a nonnegative linear combination 
of elements of the basis {^a}- Here we are concerned with the /i-basis, 
{h\ : A G Par}, where hx = hx^ ■ ■ ■ hx^. for A = (Ai > ■ ■ ■ > A^), and the 
Schur basis {sa : A G Par}. Since /i-positivity implies Schur-positivity, 
the following result also holds for the Schur basis. 

Theorem 5.1. Using the h-basis to partially order the ring of symmet- 
ric functions, we have for all n,j, k, 

(1) the Eulerian quasisymmetric functions Qn,j,k o-nd Qnj are h- 
positive symmetric functions, 

(2) the polynomial ^"=o QnjM'' ^■^ t-symmetric and t-unimodal with 
center of symmetry 

(3) the polynomial X]j=o Qnjt^ is t-symmetric and t-unimodal with 
center of symmetry . 

Proof. Part (1) is a corollary of Theorem 11.21 (see also Corollary 14. 2p . 

Parts (2) and (3) follow from Theorem 11.21 and results of Stem- 
bridge [HI] on the symmetric function given on the right hand side 
of (11. 3p . For the sake of completeness, we include a proof of Parts (2) 
and (3) based on Stembridge's work. 

It is well-known that the product of two symmetric unimodal poly- 
nomials in N[t] with respective centers of symmetry ci and C2, is sym- 
metric and unimodal with center of symmetry ci-\- C2- This result and 
the proof given in [57l Proposition 1.2] hold more generally for poly- 
nomials over an arbitrary partially ordered ring. By Corollary 14.21 we 
have 

n— 1 L 2 -I 

i=0 "^=0 ki,.. .,km > 2 *=1 

J2ki = n — k 

Each term hk YULi hkit[ki — l]f is t-symmetric and t-unimodal with 
center of symmetry ^j>o ^ = -^^^ Hence the sum of these terms has 
the same property. 
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With a bit more effort we show that Part (3) also follows from Corol- 
lary 14.21 We have 

n— 1 n— 1 n— 1 1 

j=0 j=0 j=0 k>2 j=0 

By Part (2) we need only show that 

?t— 1 n—l 

x{t) ■.= Y.Qn,ifii' + llllQ-,,kt^ 

j=0 k>2 j=0 

is t-symmetric and t-unimodal with center of symmetry For any 
sequence of positive integers (fci, . . . , km), let 



Gfci,...,fc„ ■=Ylhk^t[ki - l]t. 



i=l 



We have by Corollary 14.21 



n-l 



J=0 m > 



and 



n-l 



k>'2 j=0 m > 



Hence 



k2,...,k„ 



m > 

^1 5 ■ • ■ 5 2 

We claim that Gki,...,km + hk^Gk2,...,km is t-symmetric and t-unimodal 
with center of symmetry Indeed, we have 



Gk^,...,km + hk^Gk2,...,km — hki{t[ki — l]t + l)Gfc: 



'2 1 - - •i^m ' 



Clearly t[ki — l\t + 1 = 1 + 1 + . . . t''^ ^ is t-symmetric and t-unimodal 
with center of symmetry and Gk2,...,k^ is t-symmetric and t- 

unimodal with center of symmetry ^^'^^ Therefore our claim holds and 
X{t) is t-symmetric and t-unimodal with center of symmetry □ 
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We now obtain analogous results for y4maj,dcs,cxc,fix ^^j^^ y^maj,dcs,cxc 
applying the principal specializations. For the ring of polynomials Q[q], 
where q is a list of indeterminates, we use the partial order relation: for 
/(q)>fi'(q) e Q[(q)], define /(q) <q g{q) if 5'(q)-/(q) has nonnegative 
coefficients. 

Lemma 5.2. If f is a Schur positive homogeneous symmetric function 
of degree n then [q; q)nP^{f) is a polynomial in q with nonnegative 
coefficients and {p', q)n+iJ2m>oP^mif)p"^ ^■^ ^ polynomial in q and p 
with nonnegative coefficients. Consequently if f and g are homogeneous 
symmetric functions of degree n and f <schur 9 then 

iq;q)nPs{f) <(g) {q;q)nps{g) 

and 

(P; (l)n+i ps™(/)p" <{g,p) {p; q)n+i 

m>0 m>0 

Proof. This follows from Lemma 12.11 and the fact that Schur functions 
are nonnegative linear combinations of fundamental quasisymmetric 
functions (cf. [601 PP- 360-361]). □ 

Theorem 5.3. For all n, k, let 

fix((T) = k 

Then 

(1) A'i^^f}''^'^^''^^'^{q,p,q~H) is t-symmetric with center of symmetry 

n—k 
2 

(2) A^Q^''^'^^''^^'^{q,p, q~^t) is t-symmetric and t-unimodal, with center 
of symmetry ^ 

(3) A^^k'^'^^'^^^il^ t-symmetric and t-unimodal, with center 
of symmetry 

(4) ^maj,dcs,exc^g,^ -^^ q~^t) is t-symmctric and t-unimodal, with center 
of symmetry . 

Proof. Since h-positivity implies Schur positivity, we can use Lemma |5T2] 
to specialize Theorem 15.11 By Lemma \2.A\ Parts (1) and (2) are ob- 
tained by specializing Part (2) of Theorem 15.11 By fl2.12p . Parts (3) 
and (4) are obtained by specializing Parts (2) and (3) of Theorem 15. H 
respectively. □ 

Remark 5.4. The p,q = 1 case of Part (2) of Theorem 15.31 is due to 
Brenti [TJ Corollary 1]. 
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Remark 5.5. One can obtain a stronger result than Theorem 15.31 by 
using an unpubhshed result of Gessel (Theorem 17.31 below) along with 
Theorem 11.21 It follows from (17. 8p and Theorem 11.21 that 

n-l L^J 
j=0 d=0 

and it follows from (17.91) and Theorem 11.21 that 

I 71 — k I 

n-l L^-J 
j=0 d=0 

where fn,d and fn,k,d are Schur positive symmetric functions of degree n 
(see [52] for further details). Now by Lemma [5.21 we have the following 
strengthening of Theorem 15. 3t 

(1) A^Q^''^^^'^'^'^{q,p,q~H) has coefficients in when expanded 

in the basis {t'^(l + t)"-^'^}^!^?^ 

(2) A™^-'''^'^^'*^™(g, l,q~H) has coefficients in N[q] when expanded in 
the basis {^'^(l + t)n-'=-2d|L(n-fc)/2j 

(3) A™^j'*^^'^(g, 1, q~^t) has coefficients in N[g] when expanded in the 

basis {t'^(l + t)"-i-2'^}ito"'^^'^- 
See [B] for a discussion of the third result in the special case that q = 1, 
that is for the Eulerian polynomials An{t). 

In Section [5^ we conjectur^that the t-symmetric polynomial A^'^f^''^'^^'^^'^{q,p, q~^t) 
is t-unimodal even when /c 7^ andp 7^ 1. However, A™^j''^'''^''^^'^(g,p, q~^t) 
is not t-symmetric as can be seen in the computation, 

^maj,des,exc^^^ p, q~H) = 1 + (3p + 2pq + pq^ + 2p\^ + 2/g3 + p\'')t 

+ (3p + + p^g + 3p^g^ + 2p^g^ + p^q'^)t^ 
+ pt^ 

The Eulerian numbers possess a property stronger than unimodality, 
namely log-concavity (see [131 P- 292]). A sequence (sq, . . . , Sn) of real 
numbers or polynomials with real coefficients is said to be log-concave 
if sf — > for all i = 1, . . . , n — 1. Clearly if (sq, . . . , s„) 

is log-concave and each Sj > then (sq, . . . , s„) is unimodal. It is 



^ This conjecture was recently proved jointly with A. Henderson. See Section [5] 
(New developments). 
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natural to ask whether the unimodahty results of this subsection have 
log-concavity versions. Using the Maple package ACE [53], we obtain 



Qi,l ~ Q^,2Qbfi — ^5,4,1 ~ ^5,2,2,1 + +^5,3,2 + 4/?.4^3,2,l + ^4,4,1,1 + ^h^;i,2,2- 

Hence Q\ i — Q^^2Qbfi is not h-positive. However, using ACE we have 
verified the following conjecture for n < 8. 

Conjecture 5.6. For alln,j, k, the symmetric functions Q\ ,j—Qn,j+iQn,j~i 
and Qnj^k ~ Qn,j+i,kQn,j-i,k are Schur-positive. 

Conjecture 5.7. For all n, k, the coefficients of the t-polynomials 

^maj,des,exc^^^^^ g-lf^ qj^^ ^maj,dcs,cxc g-^f^ form loQ-COnCaVC SCqUCnCCS 

of polynomials in q and p. 

5.2. Cycle type Eulerian quasisymmetric functions. By means 
of ornaments we extend the symmetry results of Section 15.11 to the 

c. i /O J /imai,des,exc/ ,\ i 4 mai,des,exc / ,\ • .1 

refinements Q\,j and [q,p,t), where [Q^P^t) is the 

cycle type {q,p)- Eulerian polynomial defined for each partition A h n 
by 

^maj,des,cxcj^^^^^^^ _ ^ ^maj(a)pdcs(a)^exc(CT) _ 

cr € 6„ 
A(o-) = A 

Theorem 5.8. For all X \- n and j = 0, 1, . . . , n — 1, the Eulerian 
quasisymmetric function Qxj is a symmetric function. 

Proof. This result can be proved using plethysm; it follows immedi- 
ately from Corollary 16.11 below by applying the plethystic inverse of 
Sn>o both sides of (16. 2p . Here we give a bijective proof involving 
ornaments. 

For each /c G P, we will construct an involution on necklaces that 
exchanges the number of occurrences of the letter k (barred or un- 
barred) and k + 1 (barred or unbarred) in a necklace, but preserves 
the number of occurrences of all other letters and the total number of 
bars. The result will then follow from Corollary 13.31 We start with 
necklaces that contain only the letters {k, k, k + 1, k + 1}. Let R be 
such a necklace. We may assume without loss of generality that k = 1. 
First replace all I's with 2's and all 2's with I's, leaving the bars in 
their original positions. The problem is that now each 2 that is followed 
by a 1 lacks a bar (call such a 2 bad) and each 1 that is followed by a 
2 has a bar (call such a 1 bad). Since the number of bad I's equals the 
number of bad 2's, we can move all the bars from the bad I's to the 
bad 2's, thereby obtaining a necklace R' with the same number of bars 
as R but with the number of I's and 2's exchanged. Let ipi^R) = R' . 
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Clearly ip\R)_= R. For example if R = (22111222211111) then we 
get (11222111122222) before the bars are adjusted. After the bars are 
moved we have ip{R) = (11222111122222). 

Now we handle the case in which R has (barred and unbarred) /c's 
and k + Vs, and other letters which we will call intruders. The intruders 
enable us to form linear segments of R consisting only of (barred and 
unbarred) k's and k + Vs. To obtain such a linear segment start with 
a letter of value k or k + 1 that follows an intruder and read the letters 
of -R in a clockwise direction until another intruder is encountered. For 
example if 

(5.2) R = (533443333663334244) 

and k = 3 then the segments are 33443333, 3334, and 44. 

There are two types of segments, even segments and odd segments. 
An even (odd) segment contains an even (odd) number of switches, 
where a switch is a letter of value k followed by one of value k + 1 ot 
a letter of value k + 1 followed by one of value k. We handle the even 
and odd segments differently. In an even segment, we replace all /c's 
with k + I's and all k + I's with fc's, leaving the bars in their original 
positions. Again, at the switches, we have bad fc's and bad k + I's, 
which are equinumerous. So we move all the bars from the bad fc's to 
the bad + I's to obtain a good segment. This preserves the number 
of bars and exchanges the number of /c's and k + I's. For example, the 
even segment 33443333 gets replaced by 44334444 before the bars are 
adjusted. After the bars are moved we have 44334444. 

An odd segment either starts with a k and ends with a A; + 1 or 
vice- verse. Both cases are handled similarly. So suppose we have an 
odd segment of the form 

k'^'ik + i)'^^k'"'{k + 1)"^^ . . . k'^^^-'ik + 1)'"2^ 

where each > and the bars have been suppressed. The number of 
switches is 2r — 1. We replace it with the odd segment 

k'^'ik + l)'^'k'^^{k + 1)"^^ . . . k'^^^i^k + l)™2.-i^ 

and put bars in their original positions. Again we may have created bad 
/c's (but not bad k + I's); so we need to move some bars around. The 
positions of the bad fc's are in the set {A''i + m2, A''2 + m4, . . . , A^r-|-m2r}, 
where Ni = YlT=i^ ^t- there is a bar on the k in position Ni + m2i we 
move it to position Ni + m2i-i, which had been barless. This preserves 
the number of bars and exchanges the number of /c's and k + I's. For 
example, the odd segment 3334 gets replaced by 3444 before the bars 
are adjusted. After the bars are moved we have 3444. 
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Let ip{R) be the necklace obtained by replacing all the segments in 
the way described above. For example if R is the necklace given in 
dESD then 

ip{R) = (544334444663444233). 

It is easy to check that ijj^{R) = R for all necklaces R. Now extend 
the involution ip to ornaments by applying ip to each necklace of the 
ornament. 

□ 

Theorem 5.9. For all \ \- n with exactly k parts equal to 1, and 
j = 0,...,n- k, 

Qx,j Q X,n—k—j • 

Proof. We construct a type-preserving involution 7 on ornaments. Let 
R be an ornament of type A. To obtain 7(-R), first we bar each unbarred 
letter of each nonsingleton necklace of R and unbar each barred letter. 
Next for each i, we replace each occurrence of the ith smallest value in 
R with the ith largest value leaving the bars intact. Clearly 7(-R) is 
an ornament with n — k — j bars whenever R is an ornament with j 
bars. Also 7^(-R) = R- The result now follows from the fact that Qxj 
is symmetric (Theorem 15. 8p and from Corollary 13.31 □ 

Remark 5.10. Although the equation 

(5.3) Qn,j Qn,n—l—j 



follows easily from Theorem II. 2[ we can give a bijective proof by 
means of banners, using Theorem 13.61 We construct an involution 
r on ^Ki ^^^^ similar to the involution 7 used in the proof of 
Theorem 15.91 Let i? be a banner of length n with j bars. To obtain 
t{B), first we bar each unbarred letter of B, except for the last letter, 
and unbar each barred letter. Next for each i, we replace each occur- 
rence of the ith smallest value in B with the ith largest value, leaving 
the bars intact. Clearly t{B) is a banner of length n, with n — 1 — j 
bars. 

Since Qn,j,k and Qnj are h-positive, one might expect that the same 
is true for the refinement Q\j- It turns out that this is not the case as 
the following computation using the Maple package ACE [BS] shows, 

(5.4) Q{6),3 = 2/l(4,2) — ^(4,1,1) + ^(3,2,1) + ^(5,1)- 

Therefore Theorem 15.11 cannot hold for Qx^n, as stated. However, by 
expanding in the Schur basis we obtain 

Q(6),3 = 3S(6) + 3S(5,i) + 3S(4,2) + 5(3,3) + -3(3,2,1), 
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which estabhshes Schur positivity of Q(6),3- We have used ACE [63] to 
confirm the following conjecture for A h n up to n = 8. 

Conjecture 5.11. @ Let X\- n. For all j = 0, 1, . . . , n — 1, the Eulerian 
quasisymmetric function Q \ j is Schur positive. Moreover, Q\j — Q\j-i 
is Schur positive ifl < J < -^^^ where k is the number of parts of X that 
are equal to 1. Equivalently, the t-symmetric polynomial ^2^=0 Q >^,j^'' 
is t-unimodal under the partial order relation on the ring of symmetric 
functions induced by the Schur basis. 

Remark 5.12. We have also verified using ACE that Q\ j — Q xj+iQ xj-i 
is Schur-positive for all A h n where n < 8. Thus it is reasonable to 
conjecture that this is true for all n,j, and that log-concavity versions 
of the unimodality conjectures given below, hold. 

From Stembridge's work [62] one obtains a nice combinatorial de- 
scription of the coefficients in the Schur function expansion of Qn,j,k- 
It would be interesting to do the same for the refinement Q\j, at least 
when A = (n). In Section IH] we discuss the expansion in the power sum 
symmetric function basis. 

By Lemmas 12.41 and 15. 2^ we have the following consequence of The- 
orem [5?9] (and refinement of Part (1) of Theorem 15. 3p . 

Theorem 5.13. Let X be a partition of n with exactly k parts of size 
1. Then A^^^''^'^^''^^^{q,p,q~^t) is t-symmetric with center of symmetry 

n—k 
2 ■ 

The q,p = 1 case of the following conjecture was proved by Brenti 
Theorem 3.2]. 

Conjecture 5.14. Let X be a partition of n with exactly k parts 
of size 1. Then the t-symmetric polynomial is 
t-unimodal (with center of symmetry ^^^-^). Consequently for all n, k, 
^maj,des,excj^^^^^ g-i-j-^ t-symmctric and t-unimodal with center of sym- 
metry 

The next result is easy to prove and does not rely on the Qxj- 

Proposition 5.15. Let X be a partition of n with exactly k parts of 
sizel. Then for all j = 0,1, ... ,n — 1, 

axjiq,?) = ax,n-k-j{l/q,q''p)- 

^ This conjecture was recently proved jointly with A. Henderson. See Section [5] 
(New developments). 

^This conjecture was recently proved jointly with A. Henderson. See Section [S] 
(New developments). 
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Proof. This follows from the type preserving involution : — )■ &n 
defined by letting be obtained from a by writing a in cycle form 
and replacing each i hj n — i + Clearly sends permutations with j 
excedences to permutations with n — k—j excedences. Also i G DES(cr) 
if and only if n — i G DES(0((t)). It follows that preserves des and 

maj(0((7)) = des(cr)n — maj((T). 

□ 

By combining Proposition 15.151 and Theorem 15.131 we obtain the 
following result. 

Corollary 5.16. Let X be a partition of n with exactly k parts of size 
1. Then for all j = 0,1, ... ,n — 1, 

aA,,(g,p) = g'^+'-"a,,,(l/g,g». 

Equivalently, the coefficient of pH^ in A^^^''^'^^''^^^{q,p,t) is q-symmetric 
with center of symmetry j + ^+"^'^~" . 

Conjecture 5.17. The coefficient of p'^P in A^^^''^'^^''^^'^{q,p,t) is q- 
unimodal. 



6. Further properties 

The ornament characterization of Qaj yields a plethystic formula 
expressing Qx j in terms of Q(i),k- (Note (i) stands for the partition with 
a single part i.) Let / be a symmetric function in variables Xi,X2, ■ ■ ■ 
and let g he & formal power series with positive integer coefficients. 
Choose any ordering of the monomials of g, where a monomial appears 
in the ordering m times if its coefficient is m. The plethysm of / and g, 
denoted f[g] is defined to be the the formal power series obtained from 
/ by replacing Xi by the zth monomial of g, for each i. The following 
result is an immediate consequence of Corollary 13.31 

Corollary 6.1. Let X be a partition with rrii parts of size i for all i. 
Then 

|Ahl i-1 

(6.1) E^A,^'=n^™^E^w-^-^']- 

i=o j>i j=o 

Consequently, 

(6.2) = E Qi^o^'A- 

n,j>0 n>0 i,j>0 
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By specializing (16. ip we obtain the following result. Recall that (A, /i) 
denotes the partition of m + n obtained by concatenating A and /i and 
then appropriately rearranging the parts. 

Corollary 6.2. Let A and fi be partitions of m and n, respectively. If 
A and fi have no common parts then 



m + n 
m 



Consequently, if X has no parts equal to 1 then for all j , 



m + n 
m 



«Aj(g, !)• 

9 



Corollary 6.3. For all j and k we have 

Q(2J,i'=)j = hj[h2]hk- 

Moreover, 

(6.3) Yl = 11(1 - Xiz)-' 11(1- XiXjtz^)-\ 

\,j i>l l<i<j 

where A ranges over all partitions with no parts greater than 2. 

By specializing (16. 3 p one can obtain formulas for the generating func- 
tions of the (maj, des, exc) and the (maj,exc) enumerators of involu- 
tions. Since exc and fix determine each other for involutions, these 
formulas can be immediately obtained from the formulas that Gessel 
and Reutenauer derived for maj, des, fix in [311 Theorem 7.1]. 

It follows from Corollary 16.11 that in order to prove the conjecture on 
Schur positivity of Qxj (Conjecture 15. lip , it suffices to prove it for all 
A with a single part because the plethysm of Schur positive symmetric 
functions is a Schur positive symmetric function. Note that if A has no 
parts greater than 2, then by Corollary 16.31 we conclude that Qxj is 
Schur positive. 

The Frobenius characteristic is a fundamental isomorphism from the 
ring of virtual representations of the symmetric groups to the ring of 
symmetric functions over the integers. We recall the definition here. 
For a virtual representation V of (3„, let X\ denote the value of the 
character of V on the conjugacy class of type A. If A has m^ parts of 
size i for each i, define 

zx := l'"^mi!2™2m2! ■ ■ -n^-m^!. 

Let 

Pa := PAi ■ ■ "Pa,., 
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for A = (Ai, . . . , Afc), where Pn is the power sum symmetric function 
J2i>i ^7- The Frobenius characteristic of a virtual representation V of 
&n is defined as follows: 

chV := z^^ Xx Px- 

Xhn 

Recall that the Frobenius characteristic of a virtual representation p 
of &n is /i-positive if and only if p arises from a permutation representa- 
tion in which every point stabilizer is a Young subgroup. Hence, by part 
(1) of Theorem 15 .11 Qn,j,k is the Frobenius characteristic of a represen- 
tation of &n arising from such a permutation representation. However 
(15.41) shows that this is not the case in general for the refined Euler- 
ian quasisymmetric functions Qxj- (It can be shown that Q(6),3 is not 
the Frobenius characteristic of any permutation representation at all.) 
Recall also that the Frobenius characteristic of a virtual representation 
is Schur positive if and only if it is an actual representation. Hence if 
Vxj is the virtual representation whose Frobenius characteristic is Qxj 
then Conjecture 15.111 says that Vxj is an actual representation. 

Proposition 6.4. Let X \- n. Then the dimension of Vxj equals the 
number of permutations of cycle type A with j excedances. Moreover, 
the dimension ofV(^n),j is the Eulerian number an^ij^i. 

Proof. The dimension of Vxj is the coefficient of xiX2---Xn in Qx,j- 
Using the definition of Qx,j, this is the number of permutations of 
cycle type A with j excedances. 

The set of n-cycles with j excedances maps bijectively to the set 
{a G ©„_i : des((T) = j — 1}. Indeed, the bijection is obtained by 
writing the cycle in the form (ci, . . . , c„_i, n) and then extracting the 
word Cn-i ■ ■ ■ Ci. Hence the number of n-cycles with j excedances is the 
Eulerian number a„_ij„i. □ 

We have a conjectur^ for the character of V(„)j-, which generalizes 
Proposition 16.41 We have confirmed our conjecture up to n = 8 using 
the Maple package ACE [53]. Equivalently, our conjecture gives the 
coefficients in the expansion of Q{n),j in the basis of power sum sym- 
metric functions and implies that Q{n),j is p-positive. For a polynomial 
F(t) = Go + ait + ... + ttkt^ and a positive integer m, define F(t)m to 
be the polynomial obtained from F{t) by erasing all terms Ojt* such 
that gcd(m,2) 1. For example, if F{t) = 1 + t + 2t^ + 3t^ then 
F{t)2 = t + 3t^. For a partition A = (Ai, A2, . . . , A^), define 

g{X) := gcd(Ai,...,Afc). 



'This conjecture has now been proved by Sagan, Shareshian and Wachs [13] 
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Conjecture 6.5.^ For A = (Ai, . . . , Afc) h n, let 

Gx{t) := (tAk-i{t)l[[X.]t\ . 

\ i=l J g(A) 

Then 

n-l 

j=0 Ahn 

Equivalently, the character of V(.„)j- evaluated on conjugacy class A is 
the coefficient of P in G\{t). 

Conjecture 16.51 holds whenever A^ = 1, see Corollary 16.81 It fol- 
lows from this that the character of V(„)j evaluated at A = 1" is the 
Eulerian number a„_i This special case of the conjecture is also a 
consequence of Proposition 16.41 because any character evaluated at 1" 
is the dimension of the representation. In the tables below we give the 
character values for V(„)j- at conjugacy class A, which were computed 
using ACE [63] and confirm the conjecture up to n = 8. The columns 
are indexed by n, j and the rows by the partitions A. 





4,1 


4,2 


4 


1 





31 


1 


1 


2^ 


1 





21^ 


1 


2 


1^ 


1 


4 





5,1 


5,2 


5 


1 


1 


41 


1 


1 


32 


1 


2 


31^ 


1 


2 


2^1 


1 


3 


21^ 


1 


5 


1^ 


1 


11 





6,1 


6,2 


6,3 


6 


1 








51 


1 


1 


1 


42 


1 





2 


3^ 


1 


2 





4P 


1 


2 


2 


321 


1 


3 


4 


2^ 


1 





6 


31^ 


1 


5 


6 


2^1^ 


1 


6 


10 


21"^ 


1 


12 


22 


1« 


1 


26 


66 
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7,1 


7,2 


7,3 


7 


1 


1 


1 


61 


1 


1 


1 


52 


1 


2 


2 


43 


1 


2 


3 


51^ 


1 


2 


2 


421 


1 


3 


4 


3^1 


1 


3 


5 


32^ 


1 


4 


7 


41^ 


1 


5 


6 


321^ 


1 


6 


11 


2^1 


1 


7 


16 


31^ 


1 


12 


23 


2^1^ 


1 


13 


34 


21^ 


1 


27 


92 


I' 


1 


57 


302 





S 1 


8 9 


o, o 




o 


1 





1 

1 





71 


1 


i 


i 


1 


62 


1 





2 





53 


1 


2 


3 


3 


4 


1 





3 





61 


1 


o 
Z 


r> 
Z 


z 


521 


1 


3 


4 


4 




1 


3 


5 







-1 

i 







U 


3 2 


1 


4 


o 

8 


10 


51 


1 


5 





6 


421 


1 





1 1 
11 


12 


o i 


1 

i 


c 



1 O 

iz 


ib 


32^1 


1 


7 


17 


22 


2^ 


1 





23 





41^ 


1 


12 


23 


24 


321-^ 


1 


13 


35 


46 


2^1^ 


1 


14 


47 


68 


3P 


1 


27 


93 


118 


2^1^ 


1 


28 


119 


184 


2^ 


1 


58 


359 


604 


1« 


1 


120 


1191 


2416 



Conjecture 16.51 resembles the following immediate consequence of 
Theorem 11.21 and Stembridge's computation [611 Proposition 3.3] of 
the coefficients in the expansion of the r = 1 case of the right hand 
side of f ll.3p . in the basis of power sum symmetric functions. 



Proposition 6.6. We have 



j=0 



Ahn 



1=1 



where i{X) denotes the length of the partition A and Aj denotes its ith 
part. 

By using banners we are able to prove the following curious fact 
about the representation V(^n),j- 

Theorem 6.7. For all j = 0, ... ,n — 1, the restriction of V(„)j to 
&n-i is the permutation representation whose Frobenius characteristic 

is Qn—l,j—l ■ 
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Proof. Given a homogeneous symmetric function / of degree n, let / 
be the polynomial obtained from / by setting = for all i > n. 
Since / is symmetric, / determines /. 

We use the fact that for any virtual representation V of ©„, 

d_ 

dXr^ 



(6.4) chn6„_i = 7^chl^U„=o- 



By Theorem 13. 6[ Q(n),j is the sum of weights of Lyndon banners of 
length n, with j bars, whose letters have value at most n. The partial 
derivative with respect to x„ of the weight of a such a Lyndon banner 
i? is unless n or n appears in B. Since B is Lyndon, n must be its 
first letter. If the partial derivative is not after setting Xn = then 
all the other letters of B must be less in absolute value than n. In 
this case, the partial derivative is the weight of the banner B' obtained 
from B by removing its first letter n. We thus have 

(6.5) Ach^.|,^^o = ^wt(5'), 

where B' ranges over the set of all banners obtained by removing the 
first letter from a Lyndon banner of length n with j bars, whose first let- 
ter is n and whose other letters have value strictly less than n. Clearly 
this is the set of all banners of length n — 1, with j — 1 bars, whose 
letters have value at most n — 1. Thus the sum on the right hand side 

of fl6.5p is precisely Qn-ij-i- It therefore follows from (16.41) that 
which implies 

□ 

Theorem 16.71 along with Proposition 16. 6^ allows us to prove that 
Conjecture 16.51 holds when A has a part of size one. 

Corollary 6.8. Let A = (Ai,...,Afc = 1) be a partition of n and let 
cr G &n have cycle type A. Then the character ofV(^n),j evaluated at a 
is the coefficient of P in tAk^i{t) Y['i=i[^i]t- 

Proof. We may assume that a fixes n, which allows us to think of a 
as an element of &n-i- Let be the representation of (3„_i 

whose Frobenius characteristic is Qn-ij-i- By Theorem 16.71 the char- 
acter value in question is equal to the character value of a on Vn-ij-i- 
Corollary 16.81 now follows from Proposition 16.61 □ 
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7. Other occurrences 

The Eulerian quasisymmetric functions refine symmetric functions 
that have appeared earher in the hterature. A multiset derangement 
of order n is a 2 x n array of positive integers whose top row is weakly 
increasing, whose bottom row is a rearrangement of the top row, and 
whose columns contain distinct entries. An excedance of a multiset 
derangement D = (dij) is a column j such that dij < d2j- Given a 
multiset derangement D = (dij), let := HiLi^'ii.i- -^^^ 3 < 
let Vnj be the set of all derangements in (3„ with j excedances and 
let AiVn j be the set of all multiset derangements of order n with j 
excedances. Set 

Askey and Ismail [1] (see also [37]) proved the following t-analog of 
MacMahon's |3S1 Sec. Ill, Ch. Ill] result on multiset derangements 

where Cj is the ith elementary symmetric function. 
Corollary 7.1 (to Theorem II. 2p . For alln,j > we have 

(7.2) dnji^X.) = ijjQnJfl = ^ -^[n-l]\DEX(CT),n, 

where uj is the standard involution on the ring of symmetric functions, 
which takes hn to e„. Consequently, 



(7.3) <J(l,g,g^...) = (g;g)„^ ^ q 



comaj{(7)+j 



and 

(7.4) ^p-pS„rf„,,(x) = (p;g)-|, ^comajM+.^n-dcsM+l^ 

m>0 o-eVnj 

Proof. The right hand side of ( 17. ip can be obtained by applying u to 
the right hand side of fll.4p and setting r = 0. Hence the first equation 
of (E21) holds. 

The involution on the ring Q of quasisymmetric functions defined 
by Fs,n ^ F[n-i]\s,n restricts to u on the ring of symmetric functions 
(cf. [601 Exercise 7.94.a]). Hence the second equation of (17. 2p follows 
from the definition of Qn,j,o- Equations (17. 3p and (I7.4p now follow from 
Lemmas O and O □ 
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Let Wn be the set of all words of length n over alphabet P with no 
adjacent repeats, i.e., 

Wn := {u; G P" : w{i) ^ w{i + 1) = 1,2, . . . ,n - 1}. 

Define the enumerator 

Yn{Xi,X2, ...):= 

weWn 

where x"" := Xw{i) ■ ■ ■Xw(n)- In [H] Carlitz, Scoville and Vaughan prove 
the identity 



(7.5) 



n>0 



1 - Li>2(^- 



(See Dollhopf, Goulden and Greene [18] and Stanley [58] for alternative 
proofs.) It was observed by Stanley that there is a nice generalization 
of (I73|). 

Theorem 7.2 (Stanley (personal communication)). For all n,j > 0, 

define 

Yn,j{Xi,X2, ...):= ^ x'". 

des(«;) = j 

Then 

(7.6) y Yn,i^)fz- = T ^^^l') , , 
^ ^ ^ '^^ ' Eizt) -tEizY 

n,j>0 ^ ^ ^ ^ 

where 

n>0 

By combining Theorems 11.21 and 17.21 we conclude that 

Stanley (personal communication) observed that there is a combina- 
torial interpretation of this identity in terms of P-partition reciprocity 
[59| Section 4.5]. Indeed, words in Wn with fixed descent set S" C [n — 1] 
can be identified with strict P-partitions where P is the poset on 
{pi, . . . , pn} generated by cover relations Pi < Pi+i ifi&S and Pi+i < Pi 
if i ^ S. Banners of length n in which the set of positions of barred 
letters equals S can be identified with P-partitions for the same poset 
P. It therefore follows from P-partition reciprocity that 

(7.7) y„,,(x)=a;5^wt(P), 

B 
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summed over all banners of length n with j bars. 

In [nS] Stanley views words in Wn as proper colorings of a path P„ 
with n vertices and Yn as the chromatic symmetric function of P„. The 
chromatic symmetric function of a graph G = {V, E) is a symmetric 
function analog of the chromatic polynomial xg of G. Stanley [58| The- 
orem 4.2] also defines a symmetric function analog of (— 1'^')xg(~''^) 
which enumerates all pairs (77, c) where rj is an acyclic orientation of G 
and c : V ^ [m] is a coloring satisfying c{u) < c{v) if {u, v) is an edge 
of rj. For G = P„, one can see that these pairs can be identified with 
banners of length n. Hence Stanley's reciprocity theorem for chromatic 
symmetric functions [581 Theorem 4.2] reduces to an identity that is 
refined by (17. 7p when G = Pn- 

Another interesting combinatorial interpretation of the Eulerian qua- 
sisymmetric functions comes from Gessel who considers the set Un of 
words of length n over the alphabet P with no double (i.e., adjacent) 
descents and no descent in the last position n — 1, and the set [/„ of 
words of length n over the alphabet P with no double descents and no 
descent in the last position nor the first position. 

Theorem 7.3 (Gessel (personal communication)). 

(7.8) 1 + 5^ 5^ ^^t-^'sM^^ ^ ^)n-l-2dcs(«,) ^ Ji_^l:^^^ 



n>l wGU„ 



and 

h -H{zt)-tH{zy 

where as above x'" := ■ ■ 

The symmetric function on the right hand side of (17.81) has also 
occurred in the work of Procesi |l2], Stanley [57], Stembridge [Glj [62]. 
and Dolgachev and Lunts [17]. They studied a representation of the 
symmetric group on the cohomology of the toric variety X„ associated 
with the Coxeter complex of (5„. (See, for example [9], for a discussion 
of Coxeter complexes and [27] for an explanation of how toric varieties 
are associated to polytopes.) The action of (5„ on the Coxeter complex 
determines an action on Xn and thus a linear representation on the 
cohomology groups of Xn- Now X„ can have nontrivial cohomology 
only in dimensions 2j, for < j < n — 1. (See for example [271 Section 
4.5].) The action of ©„ on X„ induces a representation of 6„ on the 
cohomology H^^{Xn) for each j = 0, . . . ,n — 1. Stanley [57], using a 
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formula of Procesi |12] , proves that 



n-l 



{l-t)H{z) 



H{zt)-tH{zy 



n>0 j=0 



where ch denotes the Frobenius characteristic Combining this with 
Theorem 11.21 yields the following conclusion. 

Theorem 7.4. For all j = 0,1, ... ,n — 1, 



Finally, we discuss the occurrence of the Eulerian quasisymmetric 
functions and the g-Eulerian polynomials that motivated the work in 
this paper. This involves the homology of certain partially ordered 
sets (posets). Recall that for a poset P, the order complex AP is the 
abstract simplicial complex whose vertices are the elements of P and 
whose fc-simplices are totally ordered subsets of size k + 1 from P. The 
(reduced) homology of P is given by Hk{P) := Hk{AP;C). (See [67] 
for a discussion of poset homology.) 

The first poset we consider is the Rees product (-B„\ {0}) where 
Bn is the Boolean algebra on {1, 2, . . . , n} and C„ is an n-element chain. 
Rees products of posets were introduced by Bjorner and Welker in [5], 
where they study connections between poset topology and commutative 
algebra. (Rees products of affine semigroup posets arise from the ring- 
theoretic Rees construction.) The Rees product of two ranked posets 
is a subposet of the usual product poset (see [5] or [51] for the precise 
definition.). 

Bjorner and Welker [5] conjectured and Jonsson [36] proved that the 
dimension of the top homology of (i?„ \ {0}) * C„ is equal to the number 
of derangements in Below we discuss equivariant versions and q- 
analogs of both this result and refinements, which were derived in [51] 
using results of this paper. 

The poset {Bn \ {0}) * C„ has n maximal elements all of rank n. 
The usual action of ©„ on Bn induces actions of &n on {Bn \ {0}) * Cn 
and on each lower order ideal generated by a maximal element, which 
respectively induce representations of (3„ on the homology of {Bn \ 
{0}) * Cn and on the homology of each open lower order ideal. 

Theorem 7.5 ([51]). Let xi, . . . ,Xn be the maximal elements of {Bn \ 
{0}) * Cn- For each j = 1, . . . ,n, let Inj be the open lower order ideal 
generated by xj . Then dim Hn-2{In,j) equals the Eulerian number cinj-i 
and 



chH^^{Xn)=Q^ 



ch{Hn-2{In,j)) = ^^Q 
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In |5l] we derive the following equivariant version of the Bjorner- 
Welker- Jonsson result as a cosequence of Theorem I7.5[ 

n-l 

ch(^„_i((fi„, \ {0}) * Cn)) = a;^g„,,,o. 

i=o 

A g-analog of Theorem 17.51 is obtained by considering the Rees prod- 
uct {Bn{q) \ {0}) * Cn, where Bn{q) is the lattice of subspaces of 
the n- dimensional vector space over the q element field F^. Like 
{Bn \ {0}) * Cn, the q-analog {Bn{q) \ {0}) * C„ has n maximal elements 
all of rank n. 

Theorem 7.6 ([51]). Letxi, . . . ,Xn be the maximal elements of{Bn{q)\ 
{0}) * Cn- For each j = 1, . . . ,n, let In,j{q) be the open lower order 
ideal generated by xj. Then 

cr e 6n 

exc((T) = j — 1 

where comaj (a) = (2) — maj (a) . 

As a consequence, in [51] we obtain the following g-analog of the 
Bj or ner-Welker- Jonsson result: 

dim^„_i((i?„(g) \ {0}) *Cn)=Yl 

where Vn is the set of derangements in In [51] we also derive type 
EC analogs (in the sense of Coxeter groups) of the Bjorner-Welker- 
Jonsson derangement result and our g-analog. 

8. New developments 

Since a preliminary version of this paper was first circulated, there 
have been a number of interesting developments. Foata and Han [22] 
obtained a result which generalizes Corollary 11.41 and also reduces to a 
type B version of Corollary II. 4[ Hyatt [31], [35] extended our notion of 
bicolored necklaces to multicolored necklaces, enabling him to obtain a 
generalization of Theorem II. 2[ which also reduces to a type B version 
of Theorem 11.21 and also specializes to the Foata-Han result and to 
another type B analog of Corollary II. 4[ 

Foata and Han [23] use the results of this paper to study a g-analog 
of the secant and tangent numbers. 

Sagan, Shareshian and Wachs [H] prove Conjecture 16.51 and use it 
and other results of this paper to show that the polynomial A^'^^'^'^'^{u, u' 
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has positive integer coefficients if u is any |A|th root of unity. They 
give these integers a combinatorial interpretation in the framework of 
the cychc sieving phenomenon of Reiner, Stanton and White |17] . 

Shareshian and Wachs [53] introduce and initiate a study of a class of 
quasisymmetric functions which contain the Eulerian quasisymmetric 
functions Qnj and refine the chromatic symmetric functions of Stanley 
[58] . One outcome of this study is the result that the joint distribution 
of maj and exc on (3„ is equidistributed with the joint distribution of 
a permutation statistic of Rawlings [H] and des. 

The Schur positivity and unimodality conjectures of Section 5.2 (Con- 
jectures 5.11 and 5.14) were recently proved in joint work with Anthony 
Henderson. These results will appear in a forthcoming paper. 
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